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problem to a nonoperational answer sheet used for data collection of 
the 1980 youth sample. The present project was designed as a 
large-scale test of the differences between these nonoperational 
answer sheets and the operational answer sheets. Data were collected 
on the two speeded subtests from about 9,500 service applicants at 
Military Entrance Processing Stations; half used operational and half 
used nonoperational answer sheets that were employed in the youth 
sample. Scores from nonoperational answer sheets were then equated to 
scores from the operational answer sheets. Adjustments based on 
equatings between the operational and nonoperational answer sheets 
were found to resolve the observed anomalies in the 1980 sample. 
Results indicated that the 1980 sample of American youth could be 
used appropriately with these adjustments. (Author/LMO) 



************** *** ****************************************************** 

* Reproductions supplied by EDRS are the best that can be made ' 

' from the original document* ' 

*********************************************************************** 




AFHRL-TR-85-14 



tY 



AIR FORCE 



i— I 

rvj 



o 




H 

u 

M 
A 

N 

R 
E 
S 
0 
U 
R 
C 
E 
S 



ARMED SERVICES VOCATIONAL APTITUDE BATTERY: 
CORRECTING THE SPEEDED SUBTESTS FOR 
THE 1980 YOUTH POPULATION 



Toni Giuliano Wegner, Capt, USAF 
Malcolm James Ree 



MANPOWER AND PERSONNEL DIVISION 
Brooks Air Force Base, Texas 78235-5501 



July 1985 



InterlM Report for Period June 1983 - Septewbtr 1964 



US. DEPARTMENT Of EOUCATtOM 

NATIONAL INSTITUTE OF EDUCATION 
EDUCATIONAL RESOURCES INFORMATION 

CENTER (ERtCJ 
fytO% document has b*en reproduced at 
received from the person or orQeniiition 
originating ti. 
U Minor change* Mv« been mtde to improve 
reproduction Quality. 

• Points of vitw or opinions stattd in this docu- 
ment do not necessity rtpresant official NtE 
position or pO'*V\ 



Approved for public release; distribution ununited. 



LABORATORY 



v3 

o 
vr, 

9^ 



ERIC 

hniifflifiTirraaaa 



AIR FORCE SYSTEMS COMMAND 

BROOKS AIR FORCE BASE, TEXAS 78235-5601 



NOTICE 



When Government drawings, specifications, or other dttt ire used for any 
purpose other thin in connection with t definitely Government-related 
procurement, the United States Government Incurs no responsibility or any 
obligation whatsoever. The fact that the Government may have formulated or 
In any way supplied the said drawings, specifications, or other data, 1$ 
not to be regarded by Implication, or otherwise In any manner construed, as 
licensing the holder, or any other person corporation; or as conveying 
any rights or permission to manufacture, use, or sell any patented 
Invention that may In any way be related thereto. 

The Public Affairs Office has reviewed this report, and It Is releasable to 
the National Technical Information Service, where It will be available to 
the general public, Including foreign nationals. 

This report has been reviewed and Is approved for publication. 

WILLIAM E. ALLEY, Technical Director 
Manpower and Personnel Division 



DENNIS W. JARVI, Colonel, USAF 
Commander 



Unclassified 



M CUfttTV CLASSIFICATION OF THIS PAGE 



REPORT DOCUMENTATION PAGE 



1^ REPORT SECURITY CLASSIFICATION 

Unclassified 


lb. RESTRICTIVE MARKINGS 


2* SECURITY CLASSIFICATION AUTHORITY 


3. OlSTRlBUTtON/A VAILAllLi . Y OP REPORT 

Approved for public release; distribution unlimited. 


ft. OECLASSIFICATION/OOWNCRAOING SCHEOULE 


4. PERFORMING ORGANIZATION REPORT NUMICR(S) 

AFHRL-TR-35-H 


5. MONITORING ORGANIZATION REPORT NUMBER(S) 


$*. NAME OF PERFORMING ORGANIZATION 

Manpower and Personnel Division 


lb. OFFICE SYMBOL 
(It mtkmbM 
AFHRL/MOAE 


7*. NAME OF MONITORING ORGANIZATION 


«c AOORESS (City. SUtt ond 7.IP Cod*) 

Air Force Huaan Resources Laboratory 
Irooks Air Force lase. Texas 79235-5601 


7b. AOORESS (City, Staff »nd ZtP Codti 


NAME OF FUNOlNO/SPONSORiNG 
ORGANIZATION 

Air Force Huaan Resources Laboratory 


Bto. OFFICE SYMBOL 

HQ AFHRL 


f. PROCUREMENT INSTRUMENT IDENTIFICATION NUMBER 


Sc. AOORESS (City. Stdt* mnd Zlt Cod*) 

Irooks Air Force Base. Texas 78255-5601 


10. SOURCE OP PUNOING NOV 


PROGRAM 
ELEMENT NO. 

62703F 


PROJECT 
NO. 

7719 


TASK 
NO. 

18 


WORK UNIT 
NO. 
44 



11. TITLE tlnctud* Security ClsMififtion) 

Araed Services Vocational Aptitude Battery. Correcting the Speeded Subtests for the 1980 Youth Population 



12. PERSONAL AUTHOR(S) 

Vegner, Ton! Giullano Ree. Nalcoln Jaaes 



13*. TYPE OP REPORT 


13b. TIME COVEREO 


14. OATE OF REPORT fVr. Mo.. Dmyt 


15. PAGE COUNT 


Interla 


from Jun 83 TO Sep 84 


July 1965 


42 



IS. SUPPLEMENTARY NOTATION 



17. 


COSATI COOES 


IB. SUBJECT TERMS (Continue on r*i*r»t if n<ctt**ry 4nd Identify by block number) 


FIELO 


GROUP 


SUB. GR, 


1980 youth population 


05 


09 




answer sheets 








Amed Services Vocational Aptitude Battery 



19. ABSTRACT tContinu* on rtvtrn if r\<c<**«ry mnd identify by block numbtrl 



In the effort to change the reference base of the Ar«ed Services Vocational Aptitude Battery to a staple 
representative of American youth in 1980. anomalies noted In the speeded subtest performance of the new saaple 
Indicated It sight be an inappropriate reference. Discrepancies were traced to a nonoperatlonal answer sheet 
used for data collection of the 1980 youth saaple* An experimental study was conducted to correct the problem 
by equating scores on nonoperatlonal answer sheets to scores On Operational answer sheets* Oata were 
collected on the speeded subtests fro* about 9,500 service applicants at Military Entrance Processing 
Stations, hal' used operational answer sheets and half used the nonoperatlonal answer sheets that were 
employed In the youth staple. The results indicated that the adjustments for the answer sheets resolved the 
anonaltes and that the 198 r sanple of Aaerlcan youth could be appropriately used with these adjustments* 



20. OlSTRI BUTI ON/A VAIL ABILITY OF ABSTRACT 
UNCLASSIFIEO/UNLtMITEO S SAME AS RPT □ OTIC USERS □ 


21. ABSTRACT SECURITY CLASSIFICATION 


22: NAME OF RESPONSIBLE INOIVIOUAL 

Nancy A. Perrlgo 
Chief, STINFO Office 


22b TELEPHONE NUMBER 
tlneludt Art* Cod*; 

(512) 536-3877 


22c OFFICE SYMBOL 
AFHRL/TSR 



DD FORM 1473, 83 APR edition of i jan 73 is obsolete. Unclassified 



SECURITY CLASSIFICATION OF THIS PAGE 



BEST COPY AVAILABLE 



9 

ERJC 



Unclassified 

SECURITY CLASSIFICATION Of THIS PAGE 



Ittn 19 (Cont«nutd): 

enlistment quiHficitlon 
personnel selection 
reference populitlon 
speeded subtests 
test equttlng 



Unclassified 

SECURITY CLASSIFICATION OF THIS PAQf 



BEST COPY AVAILABLE 



9 

ERJC 



SUMMARY 



In tht late 1970s, tht Department of Defense requested that tht reference population for the 
Arned Strvlcts Vocational Aptltudt tatttry (ASYAI), which at that Mm was based on a 1944 
sample, bt chanfto and vpdaUd to rtfUct tht current youth population* An Invtstlfttlon was 
conducted In 1960 to collect tht data for tht now rtftrtnct group* Analysts of tht data 
Indicated that speeded subtest scores of tht new sample were atyplcally low and that tht simple 
wight therefore be Inappropriate for ust as a rtftrtnct* 

A preliminary Investigation at tht Air Force Huaen Resources Laboratory traced tht problem to 
a nonoperatlonal answer shttt ustd for data collection of tht 1910 youth sample* Tht prtstnt 
project was designed as a large-sccle test of tht differences between these nonoperatlonal answer 
sheets and the operational answer sheets, In an effort to find an adjustment to resolve the 
differences* Data were collected on the two ASVAI speeded subtests fro« about 9, $00 service 
applicants at Military Entrance Processing Stations* Half of the applicants used operational 
answer sheets; half used the same type of nonoperatlonal answer sheets that were emmloyed In the 
1960 youth sample. The speeded subtest scores from the nonoperatlonal answer sheets were then 
equated to the speeded subtest scores from the operational answer sheets* Adjustments based on 
these equatlngs were found to resolve the observed speeded subtest anomalies )n the 1960 youth 
sample* It was recommended that the adjustments developed In this project be made to the speeded 
subtest data for the 1980 youth sample and that ASVAI Forms 11, 12, and 13 be Implemented In this 
new score metric* 
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ARMED SERVICES VOCATIONAL APTITUDE IATTERY: CORRECTING THE SPEEDED SUITESTS 
FOR THE 1WO YOUTH POPULATION 



I. INTRODUCTION 

This study dtscrlbts tht development of adjustiKRts to data obtalntd from the 1960 rtftrtnct 
population for tht Armed Services Vocational Aptitude latttry (ASVA1). Tht ASYAI 1s tht primary 
stltctlon and classification device for tnllsttd tntry to all of tht armed strvlcts. It Is a 
multiple aptltudt batttry comprised of tlfht power subtests and two spttdtd subtests. Tht 
rtftrtnct population for this test, as wall as for most previous aptltudt ttsts for Military 
enlistment, was tstabllshtd on a World Var II sample of approximately 600,000 salts who wtrt In 
tht strvlcts In 1944. 

Tht Department of Dtftnst dtcldtd In tht lata stvtntlts that tht rtftrtnct population for tht 
ASYAI should bt updattd to bt rtprtstntatlvt of tht currtnt youth population. In I960 tht 
National Opinion Rtstarch Ctnttr (NORC) colltcttd a saaplt of American Jouth for ust as a 
normative bast for tht ASYAI (NcWIlHams, I960). To accomplish this, ASYAI For* lax was 
administered to a saaplt of about 12*000 youth betwttn tht a§ts of 14 and 23. Thty constitute a 
stratlfftd probability saaplt that was statistically wtlfhttd to bt rtprtstntatlvt of American 
youth* A subsaaplt consisting of tht II through 23 ytar old aalts and females was Identified for 
use as tht 1910 rtftrtnct population for tht ASYAI (Malar I Slat, 1912). Original plans wart to 
Implement this 1910 scort scalt as tht noraatlvt rtftrtnct for tht ASYAI 1n Octobtr 1913. 

In prtparatlon for tht Implementation of tht 1910 scalt metric, work was don* to translatt 
the ASYAI subttsts and coaposltts Into tht ntw scort scalt (Malar I Sims, 1912; Rte, Yaltntlnt, I 
Earles, 1965). An additional Investigation by Slas and Haler (1913) at tht Ccnttr for Naval 
Analyses txplortd tht approprlattntss of this ntw scalt metric for alllttry use. As part of 
thtlr analysts, thty coapartd tht rtsults obtalntd froa tht aalts 1n tht II throufh 23 ytar old 
segment of tht Aatrlcan youth saaplt to tht rtsults obtalntd froa stvtral samples of aalt 
allltary applicants and recruits, aaktng comparisons at different aptltudt levels. Coaparlsons 
ware aadt using only aalts btcaust tht 1944 noraatlvt bast for tht ASYAI was bastd on aalts 
only. (Sat Tabla 1 for Identification of tht subtests In ASYAI). Coaparlsons on tht ttn 
subttsts rtvtaled that the saaple of Aatrlcan aale youths and the saaples of aale allltary 
applicants and recruits did not differ significantly on any of the eight power subtests. Notable 
differences In subtest perforaance were found, however, on both the Nuaerlcal Operations (NO) and 
Coding Speed (CS) subtests (the two speeded subtests of the ASYAI). The differences were such 
that at each aptitude level* scores fcr those In the 1960 youth saaple were consistently lewer 
than scores for those tested In allltary testing environments. After controlling for general 
ability, this difference, In favor of allltary groups, was 3.01 raw score points on NO and 1.14 
raw score points on CS. 

Table 1. Subtests In ASYAI Foras I Through 10 



Number of 
Iteas 

25 
30 
35 
15 
50 
64 
25 
25 
25 
20 

BEST COPY AVAILABLE 



Subtest 

General Science (CS) 
Arithmetic Reasoning (AR) 
Word Knowledge (WK) 
Paragraph Comprehension (PC) 
Numerical Operations (NO)* 
Coding Speod (CS)* 
Auto and Shop Information (AS) 
Mathematics Knowledge (MK) 
Mechanical Comprehension (KC) 
Electronics Information (EI) 
^Speeded Subtests. 




Sins and Miter 0963} concluded from these results that If tht 1980 reference population *tre 
ustd, tht speeded tubtttt shorts of persons tested under Military conditions would bt Inflated. 
Thty projtcttd thai the amount of Inflation would ranft from about four ptrctntllt points on tht 
Armed Forcts Qualification Ttst (AFQT), tht major enlistment stltctlon composite, to 13 
ptrctntllt points on tht Air Forct Administrative Composite, Sims ant Maltr sufftsttd that tht 
deviations on tht spttdtd subtest* were tht rtsult of dlfftrtncts between tht NORC and Military 
testing environments, Thty recommended that iMpltmtntatlon of tht 1960 scalt attrlc as tht ASYAB 
rtftrtnct population bt delayed until tht tssut of differential performance on tht spttdtd 
subttsts could bt resolved. 

Following this report, Earles, Glullano, Ree, and Valentine (1963) conducttd an Invtstlgatlon 
of tht spttdtd subttst tfftcts. A preliminary review of tht NORC and Military tasting procedures 
ltd to che evaluation of thrtt plausible hypotheses for tht dlfftrtnct bttvttn tht NORC and 
■llltary groups. Tht first hypothtsls was that tht dlfftrtncts found In subttst scorts rtfltcttd 
a rtal dlfftrtnct In performance bttwttn civilian samples and Military samples. Tht stcond 
hypothtsls, dtvtloptd afttr cartful Inspection of tht ttstlng Materials ustd In tht NORC study, 
was that tht NORC answtr shttts varltd tnough fro« operational ASVAl answer shttts (DoD Form 
1304. 12-C) to account for tht dlfftrtnct In spttdtd subttst performance. A previous 
Investigation by Valtntlne and Cowan (1974} had suggested that answwr shttt format could have a 
significant Impact on perforMance. Finally* adMlnlstratlve differences In the NORC versus 
Military testing environments (e.g., tlMt of day tested, subject Motivation) were hypothesized to 
be potential sources of differential subtest perforMance. 

Investigation of these three hypothtsts rtvtaltd that variations In answtr shttts could 
account for alMOSt all of tht dlfftrtncts In spttdtd subttst performance observed by SIms and 
Nalcr (1963). Earlts et al. (1963) based this conclusion on a research study conducted with 512 
aale Air Forct basic tralntts. Using randoM assignment, half of the exaMlnees were adMlnlstered 
ASYAB ForM 6a on operational answer sheets as per standard Military testing procedures, and half 
wtrt adMlnlstered ASYAB ForM 6ax on NORC answer sheets as was done In the 1960 youth study. 
ForMS 6a and 6ax are Identical In content but differ In layout (for exaMple, the number of kerns 
per column differs). For the experimental session, Forms 6a and 6ax were used to replicate prior 
testing conditions. Tht answer sheets differed In several ways, the *ost obvious being the size 
and shape of the response indicators. On the NORC answer sheets, responses were made In circles 
2.36mm In diameter. Included on the answer sheet was an example of a correct response. It 
specified that the circles should bt coMplettly filled In, which Is tlMt-consuMlng. On the 
operational answer sheets, responses were Made In brackets about 1mm wide and 4mm high* The area 
within these brackets can be filled In rapidly. Anothtr notablt dNtlnctlon bttwttn tht two 
answer sheets Involved the layout of response grids. The layout of response grids on the 
operational answer sheets corresponded exactly with the layout of the Items In the ASYAB 6a test 
booklets. For example, for an Item at the top of the second column, the response grid was at the 
top of the second column on the answer sheet. The layout of the Items In tht ASYAB 6ax test 
booklets had no correspondence with the layout of response grids on the NORC answer sheets. 

The results of this pilot study showed a difference between the two answer sheet groups of 
about 3.41 raw score points for NO and 1.46 raw score points for CS, with higher scores obtained 
by those using the operational answer shttts. Other Indices revealed that tht groups wtrt 
tqulvalent In aptitude. Equlpercentlle equatlngs between the operational answtr sheet group and 
the NORC answer sheet group were performed for MO and CS. Adjustments were developed from these 
et,uat1ngs to correct the scores obtained when the NORC answer sheets were used. These 
adjustments were then applied to the subsample (16 through 23 year old sales) In the NORC study 
for whoM the original discrepancy had been noted by SIms and Haler (1963). Through a series of 
linear models analyses (Ward t Jennings, 1979), It was determined that the adjustments froM the 
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equating* corrected the speedtd subtest discrepancies between the HORC sampl* and military 
samples. Earlts et al. (1993) concluded from this Investigation that It would be possible to 
make adjustments to the speeded subtest scores In the I960 youth sample to sake It an appropriate 
reference population. Although the results of the Carles et al. (1963) study were encouraging, 
the sample on which the equating* were based was relatively snail and restricted In that It 
consisted of male Air Force basic recruits who were not representative of lower aptitude levels. 
The present rewarch was conducted to extend the Earles et al. (1963) study using a large sample 
that was representative of applicants to all the anted services. It was believed that the 
equating* based on this sample would confirm the results of the pilot study and provide stable 
adjustments to the 1990 reference population* 



Approximately 9,490 applicants for military service (15% females, 95* males) participated In 
this study prior to taking the production ASYA1. All military applicants who were testing for 
enllsUent were Included except subjects testing for verification of previous scores. Testing 
was conducted during October and November 1993 at 19 Military Entrance Processing Stations (HEPS) 
geographically dispersed to ensure a full ability range sample of military applicants. An 
average of 20 applicants was tested In each session, as Is the usual practice for enllsUent 
qualification testing. 



Test Administration 

Prior to the beginning of the study, test administrators were provided with special 
administrative Instructions (see Appendix A). These described the purpose of the study, and 
provided Instructions to be read verbatim. Standard operating procedures were followed at each 
HEPS In preparing applicants for testing. The test administrator explained that applicants would 
be taking two sets of tests over a period of about 3 1/2 hours. Applicants took the special 
test, consisting of the NO and CS subtests, followed by the regular production ASYAI. 

For the special test, half of the examinees received operational ASYAt answer sheets (DoD 
1304. 12-C) and half received NORC-style answer sheets as were used In the American youth 
population study. Prior to testing, the third page was removed from the operational answer 
sheets used for the special test, and all remaining subtest areas except 5 (HO) and 4 (CS) were 
crossed out. On the NORC-style answer sheets, a shaded area with the phrase •THIS PART OF THE 
TEST IS NOT USED" replaced all parts except 5 (NO) and 6 (CS). Examinees were randomly assigned 
to the two answer sheet groups. Samples of the two answer sheets are provided in Appendix 6. 

A test booklet containing the NO and CS subtests from ASYAB Form 9a was given to each 
examinee with an operational ASYAB answer sheet. A test booklet containing the NO and CS 
subtests from ASYAB Form 9ax was given to each examinee with a NORC-style answer sheet. As In 
the pilot study, the respective test forms were used to replicate actual testing conditions. 

The test administrator checked to make certain all examinees had test booklets correctly 
corresponding to their answer sheet types, and then explained to each group how to fill In the 
Identifying Information (I.e., name and social security account number). Following general 
Instructions an- 1 the reading of a Privacy Act Statement, the NO subtest (3 mln) and CS subtest (7 
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■In) were adalnlstered using standard ASVAI directions. Hlfhly accurate hand-htld digital 
tltctronlc stop watches wtrt provided to all HEPS for tlalng the special tests* 

Afttr subjects completed tht tptclal tests, tht booklets and answer sheets wtrt collected* 
Test adalnlstrators than proceeded to adalnlsttr tht production ASVAI In Hi entirety, following 
standard Instructions* Applicants wtrt randomly flven out of tht than currtntly operational 
ASVAI Foras 9a, 9b, 10a, 10b, lOx, or loy. (10x and lOy art scrambled vtrslons of 10a and lob, 
respectively,) No bre*f was allowtd bttwttn tht special and production testing* 



All raw test data from the special tests and production tests were sent to the Air Force 
Human Resources Laboratory, where the operational answer sheets used In the production tests and 
special tests were scanned. The NOItC-style answer sheets used 1n the study were scanned by the 
contractor who had printed these answer sheets* It was the sane contractor who had printed and 
scanned the answer sheets for the 1950 American youth population study* 

Data were collected fro* about 9,490 applicants. After scanning and watching production 
answer sheets with the answer sheets froa the special tests on the basis of social security 
account number, 9,90* complete cases were available* This number was reduced to 9,006 to 
random! t create an equal number of applicants In each answer sheet group* 

Data editing was accomplished with procedures sfallar to those used by ftee, Mathews, Kulllns, 
and Hassey (1962)* A key check was done to determine If applicants had coded the correct test 
form (9a through lOy) on the operational test. The easiest four Iteas on each of the UK, NO, and 
CS subtests on the production ASYAB were scored and suaatd using the key for the test fora 
Indicated* Any applicant with a score of six or less was flagged, and the 12 Iteas were scored 
with each of the other five keys. Changes were aade when the score using a test fora other than 
the one Indicated was 9 points or aore and was clearly higher than the score obtained with any 
other key. Applicants were deleted froa the sample when scores were unlforaly low due to 
suspected lack of effort or an anoaaly In the testing situation* 

Additional data editing was accoapllshed by Inspecting a series of scatter plots and 
regression analyses for the following pairs of variables: NO (special test) with NO (production 
test); CS (special test) v;1th CS (production test), CS (production test) with NO (production 
test); HK (production test) with AR (production test); NO (production test) with AN (production 
test). The first two regressions were designed to tap motivational differences between the 
special and production tests; the next two examined Motivational differences between the first 
and last half of the production test; and the final regression was designed to reveal Inforaatlon 
about test compromise. Applicants with standardized residuals outside the range of ±2.50 units 
were Identified for further scrutiny* Suspect scores were individually located on the 
appropriate scatter plots, and applicants were deleted from the sample when It was clear their 
scores were away from the bulk of the scatter* An applicant with a raw score of 40 on the 
production NO and a raw score of 10 on th* special NO, for example, was suspected of aotlvatfonal 
differences and was not included In the saaple* After the reaoval of suspect subjects (less than 
two percent), groups were made equal In size for a total of 4,299 applicants In each answer sheet 
condition* This saaple was used for all subsequent analyses. 



III. RESULT* AND DISCUSSION 



Data Editing 





Sample Comparison* 



To ensure that tht random assignment of applicants to answer shttt conditions hid rtsulttd In 
equivalent groups, tht two groups were compared on stvtral demographic variables and production 
test scores. Breakdowns of the demographic variables obtained on tppllctnts tre presented In 
Table 2. Distributions of education level, population group, and service for which applying were 
comparable for the two groups. 

Table 2. Demographic Characteristics of tht Staple 



Characteristic 


Level 




Answer Sheet Croup 




none 


Operational 


Frequency 


Percentage 


Frequency 


Percentage 


Education 


0 or less 


7 


0 


4 


0 




9 


54 


1 


50 


I 




10 


155 


4 


133 


3 




11 


796 


*9 


764 


16 




12 


409 


10 


362 


9 




HS 


1806 


42 


1841 


43 




GED 


267 


6 


289 


7 




13 + 


777 


18 


798 


19 




Blank 


2C 


1 


36 


1 


Population Group 


Amer Ind 


27 


1 


41 


1 




Span Amer 


254 


6 


298 


7 




Asian 


55 


1 


62 


1 




Black 


1068 


25 


1003 


23 




White 


2830 


66 


2825 


66 




Other 


65 


2 


66 


2 




Blank 


0 


0 


2 


0 


Service 


USAF 


594 


14 


607 


14 




Army 


2181 


51 


2222 


52 




USMC 


603 


14 


633 


15 




Navy 


823 


19 


734 


17 




Coast Guard 


98 


2 


102 


2 




Blank 


0 


0 


' 1 


0 



Descriptive iUtisttcs were computed to compare the means of the eight power subtests on the 
production test* It was expected that power subtest scores would not be affected by the 
administration of the special tests and would allow accurate comparisons of the aptitude of tht 
two groups. Table 3 shows the means of tne two answer sheet groups on the power subtests. Lack 
of statistical significance between the means revealed the two groups were equivalent In aptitude. 




BEST COPY AVAILABLE 

. 13 



'Table 3 . Pow«r .Subtest Companions 



Answer Shttt croup 



NORC Operational 
Ttit Mean SD Mean SO F Ratio 



General Scltnce 


16.104 


4.764 


15.962 


4.714 


1.41 


Arithmetic Reasoning 


16.990 


6.464 


16.676 


6.456 


•66 


Word Knowledge 


26.199 


6.532 


25.969 


6.457 


2.69 


Paragraph Comprehension 


11.067 


2.636 


11.035 


2.653 


.72 


Auto a?td Shop Information 


14.519 


5.062 


16.407 


5.126 


1.03 


Nath Knowledge 


13.613 


5.444 


13.636 


5.424 


2.26 


Mechanical Comprehension 


15.370 


4.610 


15.2V2 


4.606 


1.51 


Electronics Information 


12.556 


3.567 


12.491 


3.592 


.75 



■Degrees of freedom are 1 and 6596. Type 1 error rate was stt at 
_p < .01 per hypothesis. No F ratios wtrt significant at this level. 

Special Speeded Subtests 

Once the two groups were found to be equivalent, man comparisons were Made for NO and CS 
scores from the special test. These means are presented In Table 4. For both speeded subtests, 
the group tested with operational answer sheets performed significantly better than did the group 
tested with NORC-style answer sheets. The differences observed by Sims and Maler (1933) between 
military samples and the 1960 youth population were also found between samples of military 
applicants who used different answer sheets. This Indicates that the previously observed effects 
were more likely the result of the answer sheets, rather than testing In a military environment. 

Table 4. Speeded Subtest Comparisons 



Answer Sheet Group 



NORC Operational 

Test Mean SD Mean SD F Ratio 

Numerical Operations 32.639 6.746 35.629 0.889 281.17 

Coding Speed 45.594 12.211 46.930 12,582 24.95 

•Degrees of freedon are 1 and 8596. Type 1 error rate was set at p < .01 
per hypothesis. Both F ratios were significant at this level. ~~ 



Equating! 



After Identifying the speeded subtest differences between the two answer sheet groups, the 
score differences were reduced using adjustments from the equating*. For NO and CS, a series of 
linear and equlpercentlle equating* was done to eqiate scores on the NORC-style answer sheet to 
scores on the operational answer sheet. This would provide conversions to adjust for differences 
In scores resulting from the use of the ncnoperatlonal NORC-style answer sheets. Equlpercentlle 
equatlngs Included unsmoothed and analytically smoothed (linear, quadratic, and cubic polynomial 
regression) variants. Constraints on equated results w*re Imposed to Insure Increasing 
monotonlclty and to restrict equated scores to the raw test score range. The first four Moments 
of a distribution (mean, variance, skewness, and kurtosls) were computed for the two groups on 
the NO and CS data, and several deviation Indices (bias, average absolute deviations, and root 
mean square deviations see Ree, Mathews, Mulllns, I Massey, 1982) were computed to conpare the 
equatlngs. 
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For NO, dlfftrtnct in the shapes of tht score distributions produced by tho two answer shoot 
groups suggested that linear equating was Inappropriate. Deviation Indices showed both the 
quadratic and cubic polynomial smoothing! of the equlpercentlle equatlngs to be reasonable 
moothlng Methods. The quadratic smoothing, however, involved fewer' estimators than did cubic 
smoothing and resulted In more stable values. Thus, the . method used for NO was a constrained 
equlpercentlle equating with quadratic polynomial smoothing. Comparison! of the two groups on CS 
revealed that the shapes of the score distributions were almost Identical. Linear equating was 
therefore selected, and scores were constrained to keep them within the range of the test. 

The specified equatlngs resulted In real number scores designee to make performance on 
NORC-stylo answer sheets comparable with performance on operational answer sheets. These scores 
were rounded to Integers to make them appropriate for operational use. In the rounding procedure 
used, .5000 was added to scores, and scores were then truncated. Table I shows the raw score 
conversions for equating the NO and CS scores on NORC-stylo answer sheets to those on operational 
answer sheets. 



Table 5. Conversion of NORC Scores te Operational Scores for NO and CS 



NORC 
RAW SCORE 



NO* CS* 
(n-4,299) (n - 4,299) 



NORC NO* CS* 

RAW SCORE (n ■ 4,299) (n ■ 4,299) 



0 
1 
2 
3 
4 
5 
6 
7 
8 
9 

10 
11 
12 
13 
14 
15 
16 
17 
18 
19 
20 
21 
22 
23 
24 
25 
26 
27 
28 
29 
30 
31 
32 



0 
0 
1 
2 
4 
5 
6 
8 
9 

10 
11 
12 
14 
ID 
16 
17 
18 
19 
21 
22 
23 
24 
25 
26 
27 
28 
29 
30 
31 
33 
34 
35 
36 



16 
17 
18 
20 
21 
22 
23 
24 
25 
26 
27 
28 
29 
30 
31 
32 
33 



0 
1 
2 
3 
4 
5 
6 
7 
8 
9 
10 
11 
12 
13 
14 



42 
43 
44 
45 
46 
47 
48 
49 
50 
51 
52 
53 
54 
55 
56 
57 
58 
59 
60 
61 
62 
63 
64 
65 
66 
67 
68 
69 
70 
71 
72 
73 
74 



41 
46 

47 
48 
49 
49 
50 
50 
50 



43 
44 
45 
46 
47 
48 
49 
50 
51 
53 
54 
$5 
56 
57 
58 
59 
60 
61 
62 
63 
64 
65 
66 
67 
68 
69 
70 
71 
72 
73 
74 
75 
76 
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Table 5. (Concluded) 



NOKC 


HO* 


CS« 


NORC 


HO* 


CS* 


HAM SCORE 


(n«4,299) 


(n > 4,299) 


RAW SCORE 


(n » 4,299) 


(ft « 4,299) 


33 


37 


34 


71 




77 


34 


38 


31 


r ■ 




70 


31 


39 


36 


77 




79 


34 


39 


37 


76 




80 


37 


40 


38 


79 




81 


38 


4! 


39 


60 




82 


39 


42 


40 


11 




83 


40 


43 


41 


62 




84 


41 


44 


42 


63 




84 








64 




84 


'After adjustment fro* equating. 



Adjusted Mean Comparisons 

To examine the effectiveness of these equating*, NO and CS scores of applicants In the study 
who had taken the speeded subtests on HORC-style answer sheets were adjusted according to the 
equating* In Table 5. The weans for the HORC-style answer sheet group on HO and CS after 
adjustment are shown In Table 6. Comparisons of these means with the means of the operational 
answer sheet group (from Table 4) reveals a dramatic reduction in the differences between the two 
groups. The difference of about 3.2 raw score points on HO Is reduced to .076 raw score point; 
the difference of about 1.35 on CS Is reduced to .019 raw score point. 

Table 6 . Speeded Subtest Comparisons After NORC Adjustments 



Answer Sheet Group 

HORC Operational 
Test Mean SD Mean SD~ F Ratio 

numerical Operations 35.753 6.560 35.629 6.669 0.00 

Coding Spead 46.911 12.633 46.930 12.562 24.95 

•Degrees of freedom are 1 and 8596. Type 1 error rate was set at p < .01 
per hypothesis. Halther F ratio was significant at this level. ~~ 

From these results, It Is clear that a correction has been found which adjusts for the lower 
performance on speeded subtests attributable to the HORC-style answer sheets. This suggests that 
the problem with thi 1950 youth population on speeded subtests Is correctable by adjusting the HO 
and CS scores derived from the HORC-style answer sheets used in that study. 




1960 Youth Population Adjustments 

As further evidence that the equatlngs successfully corrected for the differential 
performance observed with the 1980 youth population, two types of analyses were conducted. 
First, for th? 16 through 23 year old malos and females In the NORC sample, comparisons were made 
between the speeded subtest scor.ii prior to *nd after adjustment based on the Integer equatlngs. 
Earlier analyses by Sims and Maler (1963) had shown that the speeded subtest scores obtained from 
the 1960 youth population were low relative to samples of military applicants and recruits when 
general aptitude level was held constant. Figures 1 ind 2 show HORC speeded subtest scores at 
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fixed ability levels before and after adjustments for NO and CS, respectively. Aptitude levels 
were based on the sum of the raw subtest scores found in a composite used by all of the 
services. The Air Force calls this the General Composite; it contains the WK, Alt, and PC 
subtests. 

In Figures 1 and 2, comparisons were made with aptitude fixed at five-polnl Army standard 
score intervals (e.g., 90*94, 95-99, 90-94). These graphs reveal that the adjustments to the 
NORC answer sheets not only correct the low performance at the mean, but consistently Increase 
speeded subtest scores at different levels of aptitude. Therefore, the adjustments are In the 
appropriate direction both In the study 1n which they were developed and In the 1990 youth 
population in which the Initial problem was discovered* 



109 r 



60 



8 40 



20 



Adjusted NO 



Unadjusted NO 




40 50 60 70 80 90 100 

GENERAL COMPOSITE (ARMY STANDARD SCORE) 



110 



129 



199 



Figure U Adjusted and Unadjusted NO Means by General Composite Scores for 
the 1990 Youth Population* 
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120 
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Figure i. Adjusted and Unadjusted CS Means by General Composite Scores for 
the 1950 Youth Population, 



Also provided for this population Is the correlation Matrix of raw subtest scores, with NO 
and CS scores before and after adjustments. Inspection of the matrix of Intercorrelatlons (Table 
7) shows little change In the relationship of speeded subtests before and after the corrections 
(In parentheses). No change should be expected for CS because It was corrected by a linear 
transformation, and correlation* Is Insensitive to linear transformation. Only a slight 
difference 1s observed for NO. Therefore, the adjustments appear to have left the structure of 
the ASYAB unchanged. 

The second type of analysis was based on work by Sims and Haler (1953) Involving comparisons 
between males In the 1950 youth population (NORC) and males tested 1n military environments, A 
series of linear models analyses was used to accomplish these comparisons. The 18 through 23 
year old males (n - 4,550) In the 1950 youth population (represented In the models by the 
dlchotomous variable NORC) were compared with a sample of male ellltary applicants (n ■ 2,621) 
tested In the 1950 Initial Operational Test and Evaluation (IOTtE) of ASYAB Forms 5/9/10 
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Table 7. Raw Subtest Scort Corrtlitlon Matrix for 19*0 Youth Population 





CS AR 


UK 


PC 


NO 


NO 


CS 


CS 


AS 


MK 


MC 


EI 


GS 


• 72 


•60 


•69 


• 52 


(.52) 


• 45 


(.45) 


.64 


.69 


.70 


.76 


AR 




•71 


.67 


.63 


(•63) 


.51 


(.52) 


• 53 


63 


.69 


• 66 


UK 






•ao 


• 60 


(.62) 


•55 


(.55) 


.53 


.67 


.60 


.66 


PC 








.60 


(•61) 


.56 


(.56) 


\42 


.64 


•52 


\57 


NO 










(.99) 


• 70 


(.70) 


• 30 


• 62 


• 40 


• 41 


NO 












(.70) 


(.70) 


(.31) 


(.62) 


Ml) 


(.42) 


CS 














(1.00) 


• 23 


.52 


• 34 


.34 


CS 
















(.23) 


(•52) 


(.34) 


(.34) 


AS 


















.4P 


.74 


♦ 75 


MK 




















.60 


.59 


MC 






















.74 



Adjusted scores. 



(rtprtstnttd by the dlchotomous variable IOT&E). For these analyses, NORC and I0T6E were 
weighted to sake the sample sizes equal, with an effective sample size of 5,297. Raw scores on 
the Air Force General Composite (GEN) were used to control for aptitude level. GEN Is a 
continuous varlatle. Interaction variables were represented by NORC*GEN and I0T6E*GEN« The 
predictor sets for the models were: 

Model 1: NORC. IOT&E, NORC*GCN, I0T*E*GEN 
Model 2: NORC, IOUE, GEN 
Model 3: GEN 

These Models were used to test differences between groups on NO and CS both before and after 
adjustments were Hade for the NORC group. Model 1 allows differences to exist between the NORC 
and IOUE samples both on regression slope and regression Intercept. Model 2 Imposes a coMon 
slope and therefore allows only the intercepts to differ. Model 3, the most restricted model, 
gives Information about general ability but does not allow for separate Information about group 
membership. 

The results of the linear models analyses are presented In Table 6. The decrease In amount 
of vat lance accounted for In Model 2 versus Model 1 was small In all cases (about .005); 
therefore, the simpler Model 2 was adopted as the full model. Comparison of Model 2 with Model 3 
for NO showed that the Information provided by knowledge about group membership resulted In a 
significant Increase In R 2 when scores were unadjusted (F(1,5294) - 177.7, p < .01). After 
adjustments were made to scores of those tested In the 1960 youth population, no difference 
existed between the groups when general ability was held constant (F(1,5294) 1.2, n.s.) 
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Table 6. Results of Linear Models Analyses of MO 
and CS Subtests for KOtC and I0T4C Stilts 



Model 1 



Model 2 



Model 3 



Criterion 



z 



7 



NO (Unadjusted) 
(Adjusted) 



.40954 
.41770 



.40431 
.41226 



.36472 
.41213 



CS (Unadjusttd) 
(Adjusted) 



.33655 
.34290 



.33227 
.33737 



.33093 
.33737 



For CS, tht difftrtnet between Modvls 2 and 3 for unadjusttd scorts was smaller, but still 
statistically significant (F(l,5294) • 10.6, £ < .01). Group membership no longer contributed to 
R 2 afttr adjustments were made to tht scores"of thost in tht 1960 youth population (F(1,S294) « 
0.0 t n.s.). Tht adjustments wtrt succtssful in reducing difftrtnets bttwttn tht 1960 population 
and Military applicants on both spttdtd subttsts. 



It is concluded that the differences Sims and Kaier (1963) observed were primarily due to the 
use of nonoperational answer sheets in the ftORC study. Tht present study adjusttd for 
differences between the NORC and operational answer sheets to produce conversions for the speeded 
subtests. These conversions provide corrections to the 1960 youth population that Hake It 
appropriate for use as a reference population for the ASYAB. The adequacy of the corrections was 
demonstrated in the present study as well as in the youth population data In which the problems 
were initially observed. 

The results suggest that with the corrections to the speeded subtests in the NORC data, ASYAB 
Forms 11/Y2/13 could be implemented as scheduled in the 1960 score scale. 



IV. CONCLUSION 
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APPENDIX A: ADMINISTRATIVE INSTRUCTIONS FOR SPECIAL TEST TYPES A » B 

(October 1983) 
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Special Equating Study 
Administrative Instructions 



This is one of the MEPS sites that has been selected for a special study 
that will last approximately one month. We would like to emphasize that this 
is a crucial study from which many important decisions will be made. The 
results from this study will serve as a bai.is for establishing the normative 
score scale for the ASYAB for the remainder of this Century. It is very 
important that you follow the instructions exactly as written, and that you 
double-check to make sure everything is right. A representative of the Joint 
Services Selection and Classification Working Group (JSSCWG), Headquarters 
MEPCW, or your sector will be sent to observe the data collection at some 
point during the study. 

The study involves a special test, which will last approximately twenty 
minutes, followed by the production ASVAB. The production ASYAB will be 
administered using standard operational procedures as prescribed in USMEPCOM 
Regulation 611-1. Therefore, only instructions for the special test are 
included in this manual. For the special test, two forms of special test 
booklets (Type A and Type B) will be used. These booklets contain only two 
subtests— Numerical Operations (NO) and Coding Speed (CS). Two different 
types of answer forms will be used for testing. One-half of the examinees in 
each session will_use pink operational answer forms (all of those using pink 
Type A test booklets); the other half of the examinees in each session will 
use blue special answer forms (all of those using blue Type B test booklets). 
Testing must be arranged so that Type A and Type B test booklets are used 
approximately equally in each session . A running total should be kept to 
verify that overall totals for each type of test booklet are approximately 
equal. An effort should be made to correct any imbalances consistent with 
good test administration procedures. 

In administering this special test, particular attention should be paid to 
the timing of the subtests and the equal distribution of the two answer forms 
in each session. Throughout this study, you will use the special electronic 
timers provided to you. To ensure the accuracy of the timers, during each 
administration of a special test, the test administrator will use an accurate 
timing device (other than the timer) to check the timer. If the provided 
timer misf unctions or fails to ring, the test administrator will stop the 
special test after no more than 5 seconds of the correct time (3 minutes for 
Numerical Operations and 7 minutes for Coding Speed). If the timer does not 
sound within 2 seconds of the correct time during the administration of a 
special test, it will be considered inaccurate. Upon identification of 
inaccurate or malfunctioning timers, use alternate timers and notify your 
Chief, Test Management Section (CTMS) immediately. 

Specific guidance and procedures for the implementation of this study are 
contained in the OPLAN prepared by MEPCOM. Based on the total number of 
examinees to be tested (approximately 8,000), selected MEPS have been assigned 
anticipated samples to test. Beginning 11 Oct 83, all examinees tested at 
your site will participate in the special testing. You will continue the 
special testing until informed by your CTMS that the testing has been 
completed. 
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Prior to each test session, the test administrator will prepare an 
adequate number of operational answer forms to be used with the Special Test 
Type A booklets. To prepare these answer forms, the last page will be 
carefully removed (so as not to separate the first two pages) and discarded. 
uFmgthe provided red felt tip pen, the test administrator will, then, draw 
an X through the remaining parts of the operational answer form that will not 
be used for the special test (that Is, cross out parts 1, 2, 3, 4, and 7). 
Following the preparation of operational answer forms, an adequate number of 
Special Test booklets will be prepared. Half the booklets prepared will be 
Type A; half will be Type B. A pink operational answer form (with the 
appropriate parts crossed out) will be inserted into each of the pink Type A 
booklets. A blue special answer form will be inserted into each blue Type B 
booklet. During the administration of the special tests, the test 
administrator will visually check to make sure the answer form used by each 
applicant is appropriate for the booklet being used. Testing materials 
required for the special testing sessions then include: Special Test Type A 
Booklets, (with operational answer forms inserted); Special Test Type B 
Booklets (with special answer forms inserted); special timers; and pencils. 

Specific Directions 

1. Distribution of Test Booklets and Answer Forms . 

To ensure an equal distribution of test booklet types, you have the option 
of ^repositioning the test booklets prior to the arrival of examinees, or 
handing out the test booklets after your opening comments. 

Upon arrival, examinees should be seated in the usual way. Then say: 



We will be administering two sets of tests to you today. The testing 
will require about three and one-half hours of your time. Both tests 
are important and necessary for you to apply for the armed services at 
this time. If you have a question, raise your hand. 



Pause and answer questions. Then say: 



If you are not able to test for the full session, for any reason, please 
indicate this by raising your hand. 



Pause and release anyone who wishes to leave. If you did not preposition the 
test booklets before examinees arrived, hand them out at this time. 

Then say: 



You have received a test booklet and an answer form. Please do not 
open the test booklets until I instruct you to do so. Do NOT separate 
or tear apart any answer forms. 
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2. Identification Information and Sample Questions. 



Identification data is extremely important for this project. The computer 
that will scan and score the answer forms does not have the capability to read 
the data for an individual unless the SSAH grids are properly coded-in on all 
paaes that are utilized. Make sure everyone pays attention and fills in the 
information at the proper time. 
Now say: 



The first thing we're going to do is fill-in the identifying informa- 
tion. Do not mark on your test booklet at any time for any reason. Do 
not mark on your answer form until I tell you to do so. Since the 
identifying information is slightly different on the two answer forms, 
I will give instructions for each group separately. When I am giving 
instructions for one group, I want the other group to sit quietly. Do 
not make any marks until I give instructions for your group. I will 
start with the group with the pink Special Test Type A booklets. Those 
of you with Test Type B, PLEASE sit quietly while those in the other 
group fill out their identifying information. For those of you with 
the pink Special Test Type A booklet, the first thing you need to do is 
to make sure you have the correct answer form. Your answer form should 
be 2 pages, printed in pink, and should have "Armed Services Vocational 
Aptitude Battery" printed at the top. It looks like this. 



Hold up a pink operational answer form {DOD 1304. 12C). Then say: 



If you have the pink Type A test booklet and yoa do not have this 
answer form, please raise your hand. 



Make necessary corrections. Then say: 



Now turn your answer form sideways so that you can read the sections 
for your name, test version, educational level, etc. 
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Pause, then say: 



On the right side of the answer form, you should see a series of 8 
blocks with the heading ."Last Name* under it. Raise your hand if you 
cannot find that area. Above the heading of " Last Name " print your 
last name or the first eight (8) letters of your name if it is longer. 
Print the first letter in the first box, the second letter in the 
second box, and so on. Then blacken the appropriate spaces below the 
letters you have printed. Be sure you code your name correctly. 

Pause, then say: 



Directly below your coded last name there is a series of blocks for your 
social security number. Raise your hand if you cannot find that area. 
Above the heading of " Social Security No .," write your social security 
number (all 9 digits) in the boxes and then blacken the corresponding 
spaces below the numbers you have written. Do this very carefully. If 
you do not know your social security number, raise your hand. 

Pause, then say: 



Now turn to the second page. Be sure you are on page 2 of the answer 
form. Find the grid labeled "Social Security No.," write your social 
security number (all 9 digits) in the boxes and then blacken the 
corresponaing space below the numbers you have written. Do this very 
carefully. It is very important that you fill in the information 
correctly on the second page. 

Check to see that instructions are properly followed. Allow time for 
examinees to finish. Now say: 



That is all the information needed for those with Test Type A. Now, 
those of you with Test Type A PLEASE sit quietly while those with Test 
Type B fill out their identifying information. For those with Test 
Type B booklet, the first thing you need to do is to make sure you have 
the correct answer form. Your answer form should be one sheet folded 
over, printed in blue, and should be labeled "Special Answer Form B." 
It looks like this. 
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Hold up a blue special answer form. Then say: 



If you have the blue Type B test booklet and you do not have this 
answer form, please raise your hand. 

Make necessary corrections. Then say: 

| Now, turn your answer form so yo u can read the marking directions. 
Pause, then say: 



At the top of the page, neatly print your last name, first name, and 
middle Initial on the line provided. 

Pause, then say: 



Now locate the grid labeled "Social Security Number" directly below 
where you have been writing. Write your social security number (all 
9 digits) In the boxes across the top and then carefully blacken the 
corresponding space below the numbers you have written, filling the 
circles completely. Do this very carefully. If you do not know your 
social security number, please raise your hand. 

Pause, check to see that Instructions are properly followed, then say: 



Now, look at the box In the upper right-hand corner of your answer 
form. Read these Instructions for marking your answer form silently 
while I read them aloud. 

• USE ML! THE BLACK LEAD PENCIL GIVEN TO YOU. 

• MAKE HEAVY DARK MARKS THAT COMPLETELY FILL THE CIRCLE. 

• ERASE CLEANLY ANY ANSWER YOU WISH TO CHANGE. 

• MAKE NO STRAY MARKINGS OF ANY KIND. 
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Pause, then say: 



This completes all the information required for Test Type B. 
Pause, then say: 

Does anyone have any questions about either answer form? 
Pause, then say: 



We have now completed all of the needed identifying information. 
Fveryone should now turn their answer forms to the front page. 

Pause, then say: 



I am now going to read to you the Privacy Act Statement. Please listen 
carefully. 

THESE TESTS WILL BE USED FOR ARMED SERVICES SELECTION SYSTEM'S 
DEVELOPMENT PURPOSES. USE OF THE SOCIAL SECURITY ACCOUNT NUMBER IS 
NECESSARY TO MAKE POSITIVE IDENTIFICATION OF THE INDIVIDUAL AND 
RECORDS. INFORMATION PROVIDED BY RESPONDENTS WILL BE TREATED AS 
CONFIDENTIAL AND WILL BE USED FOR OFFICIAL PURPOSES ONLY. 
INDIVIDUAL IDENTITY WILL NOT BE REVEALED . REGARDLESS OF WHETHER 
RESPONDENTS ARE IDENTIFIED BY NAME AND/OR SOCIAL SECURITY ACCOUNT 
NUMBER, THE INFORMATION OBTAINED WILL BE USED ONLY TO IMPROVE 
SELECTION, CLASSIFICATION, ASSIGNMENT, AND EVALUATION TECHNIQUES 
WITHIN THE ARMED SERVICES' PERSONNEL SYSTEM. DISCLOSURE OF THIS 
INFORMATION IS MANDATORY. FAILURE TO PROVIDE INFORMATION WOULD 
HINDER THE ARMED SERVICES' ABILITY TO IMPROVE THE EFFECTIVENESS OF 
THE PERSONNEL SYSTEM. THE PERSONNEL SYSTEM CONTINUES TO IMPROVE 
ONLY WITH YOUR ASSISTANCE TO MAKE ADDITIONAL REFINEMENTS IN 
POLICIES AND PROCEDURES. YOUR COOPERATION IN THIS EFFORT IS 
APPRECIATED. 

Pause, now say: 



Now open your test booklet to page 1 and read the general directions 
silently while I read them aloud. 
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Pause, then say: 



DO NOT WRITE YOUR NAME OR MAKE ANY MARKS IN THIS BOOKLET. Mark your 
answers on the separate answer forms. If you need another pencil while 
talcing this test, hold your pencil above your head. A proctor will 
bring you another one. 

Pause, then say: 



This booklet contains 2 tests. Each test has Its own Instructions and 
time limit. When you finish a test you may check your work In that 
test only. Do not go on to the next test until the examiner tells you 
to do so. Do not turn back to a previous test at any time. 

Pause, then say: 



For each question, be sure to pick the BEST ONE of the possible answers 
listed. When you hav? decided which one of the choices given is the 
best answer to a question, blacken the space on your answer form which 
has the same number and letter as your choice. Mark only In the answer 
space. BE CAREFUL NOT TO MAKE ANY STRAY MARKS ON YOUR ANSWER FORM. 
Each test has a separate section on the answer forms. Be sure you mark 
your answers for each test In the section that belongs to that test. 

Pause, then say: 

Sample Question 1. 

SI. A square has 

S1-A 2 sides 

S7-B 3 sides 

S1-C 4 sides 

ST-D 5 sides 
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Pause, then say: 



The correct answer to Sample Question SI Is C. Note how, space C 
opposite number 1 has been blackened. Your marks should look just like 
this and be placed In the space with the same number and letter as the 
correct answer to each question. Remember, there Is only ONE BEST 
ANSWER for each question. If you are not sure of the answer, make the 
BEST GUESS you can. If you want to change your answer, COMPLETELY 
ERASE your first answer mark. 

Pause, then say: 



Answer as many questions as possible. Do not spend too much time on 
any one question. Work QUICKLY, but work ACCURATELY. DO NOT TURN THIS 
PAGE UNTIL TOLD TO DO SO. 

Pause, then say: 

Are there any questions? 

Pause, answer any proper questions. 

3. Procedures for Administering Part 5, Numerical Operations . 
Now say: 

Turn to page 3 and read the directions for Part 5, Numerical Operations 
silently, as I read them aloud. 

Pause, then say: 



This is a test to see HOW RAPIDLY AND ACCURATELY you can do arithmetic 
problems. Each problem Is followed by four answers, only one of which 
is correct. Decide which answer Is correct, then blacken the space on 
your answer form which has the same number and letter as your choice. 

Pause, then say: 



Now look at the sample problem below. 
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Pause long enough for examinees to work the sample, ther say: 
The answer is 9, so the C answer Is correct. 



Pause, then say: 



This is a speed test, so work as fast as you can without making 
mistakes. Do each problem as it comes. If you finish before time is 
up, go back and check your work. 



Pause, then say: 



It is not expected that most people will finish in the amount of time 
provided. Your score is based on the number of problems answered 
correctly. It is important that you work rapidly and accurately. 



Pause, then say: 



The next thing I am going to tell you is not in your booklet. There 
are more sections on your answer form than we will use for the special 
test. The parts we will not use should have already been marked out. 
Please make sure that you locate the correct section of the answer form 
before we start each part. If you answer the questions in the wrong 
section, we will not be able to score your test or use your results. 
The first test is Part 5. For those of you with Test Type A and the 
pink answer form, the section for Part 5 is at the bottom of the first 
page. For those of you with Test Type B and the blue answer form, the 
section for Part 5 is at the bottom of Page 2, which is on the back 
of Page 1. 



Pause, then say: 



Now find the section of your answer form that is marked "PART 5." When 
you are told to begin, start with question number 1 in Part 5 of your 
test booklet and answer space number 1 in Part 5 on your separate 
answer form. DO NOT TURN THIS PAGE UNTIL TOLD TO DO SO. 
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Pause, then say: 



There are 50 problems In this test, you will have 3 minutes to work on 
them. Your score will be based on the number of correct answers. Be 
sure you mark your answers in Part 5. Are there any questions? 



Pause. Answer any proper questions. After you have answered all questions, 
set your special timer to exactly 3 minutes and be prepared to start the 
timer. Then say: 



Turn the page and begin. (Start the timer as you say begin.) 



After EXACTLY 3 minutes, say: 



STOP! Put your pencils down. 



4. Procedures for Administering Part 6, Coding Speed . 
Say: 



The next part we will be doing is Part 6, Coding Speed. Find Part 6 on 
your answer form. For those of you with Test Type A and the pink 
answer form, Part 6 is the first section on Page 2. For those of you 
with Test Type B and the blue answer form, Part 6 is the top section on 
Page 3. Make sure you have located the correct part. 



Pause, make sure everyone has found the correct section, then say: 



I Now turn directly to page 7, C oding Speed, In your test booklet. 
Pause, then say: 



Read the directions for Part 6, Coding Speed, silently as I read them 
aloud. 



Pause, then say: 



This is a test to see how quickly and accurately you can find numbers 
in a table. At the top of each page there is a number table or "KEY." 
The key Is a group of words with a code number for each word. 
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Pause, then say: 

i ■ 11 — i 

Each question in the test is a word taken from the key at the top of J 
that page. From among the possible answers listed for each question, 
you are to find the one which is the correct code number for that word. 
Then, blacken the space for that answer on your separate answer form. 

Pause, then say: 

Look at the practice key and the five sample questions below. 

i i i .I, .., , i .I — -+ 

KEY 

green 2715 man 3451 salt 4586 

hat 1413 room.... 2864 tree 5972 



SAMPLE QUESTIONS ANSWERS 







A 


B 


C 


D 


E 


SI. 


room 


1413 


2715 


2864 


3451 


4586 


S2. 


green 


2715 


2864 


3451 


4586 


5972 


S3. 


tree 


1413 


2715 


3451 


4586 


5972 


S4. 


hat 


1413 


2715 


3451 


4586 


5972 


S5. 


salt 


1413 


2864 


3451 


4586 


5972 



Pause, then say: 



Notice that each of the questions is one of the words in the key 
table. To the right of each question are possible answers listed under 
the letters A, B, C, D, and E. The word in Question SI is "room." By 
looking in the key you see that the code number for room is 2864. 
Among the five possible answers for Question SI, 2864 is listed under 
choice C, so C is the correct answer. The word for Question number S2 
is "green." By looking in the key you see that the code number for 
green is 2715. Among the possible answers, 2715 is listed under choice 
A, so A is the correct answer. 

Pause, then say: 



Now do Sample Questions S3 through S5 by yourself. First, find the code 
number for each question by looking it up in the key. Next, find that 
code number under the answer for that question. DQ NOT mark the sample 
questions on your answer form. Work them in your head. Do this now. 
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Pause long enough for examinees to work the samples. Test administrators and 
proctors must ensure that oxaminees understand the procedures for this test, 
Then say: 



Work QUICKLY, but work accurately. Most people are not able to finish 
all the questions. Do as many as you can. Your score is based on the 
number of problems ANSWERED CORRECTLY. 



Pause, then say: 





Now find the section of your answer form that is marked "PART 6." When 
you are told to begin, start with question number 1 in Part 6 of your 
test booklet and answer space number 1 in Part 6 on your separate 
answer form. DO NOT TURN THIS PAGE UNTIL TOLD TO DO SO. 




Pause, then say: 




This part has 84 questions in it. You will have 7 minutes to work on 
them. Your score will be based on the number of correct answers. Are 
there any questions? 




After all proper questions have been answered, set your timer for exactly 
7 minutes and be prepared to start the timer. Say: 




Turn the page and begin. (Start the timer as you say begin.) 




After exactly 7 minutes, say: 






STOP! Put your pencils down. Close your test booklet. This completes 
the special study part of the test. 





5. When Part 6, Coding Speed, is completed, collect all answer forms used for 
the special study and all special test booklets. Continue with the standard 
administration of the production ASVAB. Do not allow any breaks. 
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